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Abstract — The information spectrum approach gives general 
formulae for optimal rates of codes in many areas of information 
theory. In this paper the quantum spectral divergence rates are 
defined and properties of the rates are derived. The entropic 
rates, conditional entropic rates, and spectral mutual information 
rates are then defined in terms of the spectral divergence 
rates. Properties including subadditivity, chain rules, Araki-Lieb 
inequalities, and monotonicity are then explored. 

Index Tenns — Quantum information, quantum capacity, infor- 
mation spectrum. 



I. Introduction 

TRADITIONALLY, rates for data compression, channel 
capacity, and other operational quantities in information 
theory are related to entropic functions of the state (or dis- 
tribution). The underlying assumption is that the source or 
channel is identical and independently distributed (i.i.d.), or 
memoryless, over many uses, and the rate is determined in 
the asymptotic limit. The entropies themselves obey various 
mathematical relationships, many of which have additional 
operational interpretations. 

The information spectrum approach of Han & Verdu gives 
asymptotic rate formulae for many operational schemes in in- 
formation theory, such as data compression, channel capacity, 
and hypothesis testing, where very few assumptions are made 
about the source or channel [1], [2]. 

In quantum information theory the ideas of coding and 
communication are generalized to include the nature of the 
physical system in which information is encoded. Spectral 
information rates for quantum states were derived by Ogawa, 
Hayashi & Nagaoka, initially in terms of hypothesis testing 
and source coding [3], [4], and additionally to determine 
general expressions for entanglement concentration [5], and 
the classical capacity of arbitrary quantum channels [6]. 

In this paper we demonstrate that many of the mathematical 
relationships for entropies generalize to the quantum spectral 
information rates. 



II. Preliminaries 
A. Spectral Projections 

The quantum information spectrum approach requires the 
extensive use of spectral operators. For a self-adjoint operator 
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A written in its spectral decomposition A — X]i'^jN)(*l we 
define the positive spectral projection on A as 



{A>0}=J2\^){^\ 



(1) 



Ai>0 



the projector onto the eigenspace of positive eigenvalues of A. 
Corresponding definitions apply for the other spectral projec- 
tions {A < 0}, {A > 0} and {A < 0}. For two operators A 
and B, we can then define {A > B} as {A — B > 0}, and 
similarly for the other ordering relations. 



B. Two Important Lemmas 

Here the two key lemmas for many results in this paper are 
presented. 

Lemma 1: For self-adjoint operators A, B and any positive 
operator < P < I the inequality 



Ti-[P{A - B)] < Tr[{A >B}{A- B)] 



(2) 



holds. 

Proof: As both operators A and B are self-adjoint so is 
their difference A — B. Hence, we can diagonalize A — B and 
write it as the difference of two positive diagonal operators 
n > and fi > 0, such that U{A - B)W = H - f}. As the 
operator {A > B^ projects onto the positive eigenvalues of 
A — B, we find 

Tr[{A>B}{A-B)]=Tv[U] (3) 

For any positive P < I we then have 

Ti[P{A - B)] = Tr[P'(n - fl)] 

= Tr[P'n] -Tr[P'n] 

<Tr[n] (4) 

where P' = UPU^ < / is positive. Combining (|3} with 
gives the required inequality in (|2j. ■ 

Lemma 2: For self-adjoint operators A and B, and any 
completely positive trace-preserving (CPTP) map T the in- 
equality 

Tr[{r(yl) > T{B))T{A - B)] <Tt[{A>B]{A- B)] 

(5) 
holds. 

Proof: The operator A — B may be expressed in terms of 
a difference of two diagonal positive operators U [A — B)U'^ = 
n — J7. As T is a CPTP map it may be written in a Kraus 
representation as T{A) = Z^fcT'^AT^. Defining T' by the 
Kraus operators T^ = T^W implies that T' is also a CPTP 
map. Define A ^ Ti[{T{A) > T{B)}T{A~B)] -Tr[{.4 > 
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B}{A- B)], then 

A = Tr[{T{A) > T{B)}T{A - B)] - Tr[n] 

< Tr[{r(A) > r(s)}r'(n)] - Tr[n] 

< Tr[T'(n)] -Tr[n] 



= 



(6) 
(7) 
(8) 
(9) 



where Q follows from T' being a completely positive map, 
implying that T'(n) and T'{Vt) are both positive, and (|9jl is 
due to T' being a trace-preserving map. ■ 

III. Quantum Spectral Divergence Rates 

The spectral divergence rates act as generalizations of the 
relative entropy. They are defined on sequences of states p = 
{Pn]^=i (and operators), unlike the relative entropy which is 
defined for individual states (and operators). 

Definition 1: For sequences of states p — {pn}^=i and pos- 
itive operators ui — {w„}^]^, define the difference operator 
nn(7) = Pn — e"'''(^n, then the quantum spectral sup-(inf- 
)divergence rates are defined as 



D{p\\uj) + 4(5 for some (5 > 0. Then choosing a = D{p\\uj) + 
2(5, 7 = D{p\\lj) + (5, we have from LemmaQ 

Tr[{p„ > e""c^„}p„] < Tr[{p„ > e"Tc^„}(p„ - e"^c^„)] 

+ e"TTr[{p„>e""c^„K,] 

<e« + e-"'' (14) 

where e„ = Tr[{p„ > e"^a;„}(p„ - e"'^w„)] and Tr[{p„ > 
e""a;„}ci;„] < e~"" holds for any a. As the right hand side 
goes to zero asymptotically and since a < 'D{p\\u!) we have 
a contradiction. ■ 

Proposition 2: The spectral inf-divergence rate i2(p||^) is 
equivalent to 

V{p\\uj) ^ sup (a : lim Tr[{p„ > e""w„}p„] = l) (15) 

which is the previously used definition of the spectral inf- 
divergence rate. 

Proof: For any a = D.ip\\uj) — S, with J > 0, imphes 

1> lim Tr[{p„>e""w„K] 

n— >oo 

> lim Tr[{p„ > e""cc>„}(p„ - e""^„)] 



D{p\\lu) = inf {7 : Jim^ Tr [{n„ (7) > 0}n„(7)] = o} 



1 



(16) 



(10) 
D{p\\uj) = sup (7 : lim Tr[{n„(7) > 0}n„(7)] = l| 

(11) 

respectively. 

Although the use of sequences allows for immense freedom 
in choosing them, there remain a number of basic properties 
of the quantum spectral divergence rates that hold for all 
sequences. In the i.i.d. case the sequence is generated from 
product states p — {q'^^}^=i, which is used to relate the 
spectral entropy rates for the sequence p to the entropy of a 
single state g. 



A. Equivalence to Previous Definitions 

Although the definitions for the spectral divergences differ 
slightly from those in (38) and (39) of [6], they are equivalent, 
as the next propositions show. 

Proposition 1: The spectral sup-divergence rate D{p\\uj) is 
equal to 

V{p\\u;) = inf (a : lim Tr[{p„ > e""w„}p„] = o| (12) 

which is the previously used definition of the spectral sup- 
divergence rate. Hence the two definitions are equivalent. 
Proof: For any a = V{p\\lli) + S, with (5 > 0, impUes 



giving V{p\\u!) > fZipW^^), as 6 is arbitrary. For the converse 
we assume that the inequality is strict, such that ^{pWuj) = 
i2(p|ja;)+4(5 for some (5 > 0. Then choosing a = '^{p\\i^)—S, 
7 = ^CpII"-^) ^ 2(5, we have from Lemma [fl 

<Tr[{p„>e"^a;„}(p„-e"Tw„)] 



<Tr[{p„>e"^c^„}(p„-e"- 



UJ„ 



-7l5 



(17) 



= lim Tr[{p„ > 



e""w„}p„] 



> lim Tr[{p„ > e'"cc>„}(p„ - e""c^„)] 



>o 



(13) 



giving I)(p||aj) > D{p\\llj), as 5 is arbitrary. For the converse 
we assume that the inequality is strict, such that 'D{p\\uj) = 



where Tr[{p„ > e""a;„}w„] < e "" holds for any a. Thus 
lim„^oo Tr [{p„ > e"'^a;„}(p„ - e"''w„)] = 1, where 7 > 
D.{p\\^), which is a contradiction. ■ 

Despite the above equivalences, it is useful to use the 
definitions in (I1Q> and dlH for the divergence rates as they 
allow the application of Lemmas Q and |2l in deriving various 
properties of these rates. 

B. Properties of Spectral Divergences 

Proposition 3: The spectral divergence rates for a sequence 
of states p — {pn}^^i are related by 

D{p\\lu) <D{p\\uj) (18) 

for any positive sequence of operators uj ~ {oJn}'^=i- 
Proof: Let 7 be any real number such that 

lim Tr[{p„ > e"Tc^„}(p„ - e"^c^„)] = (19) 

then for any a = 7 + (5, for 5 > 0, we have from Lemma [l] 

Tr[{p„ > e""c^„}p„] < Tr[{p„ > e"^c^„}(p„ - e"'^c^„)] 

+ e-"^ (20) 
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and the right hand side goes to zero asymptotically. Hence 

lim Tr [{p„ > e""c^„}(p„ - e""^„)] =0 (21) 

n — ^oo 

for any a > 7. ■ 

Proposition 4: Under any sequence of CPTP maps T = 

{Tn]'^=i the spectral divergence rates can only decrease, that 

is 



D{p\\Lo)>D{T{p)\\r{u;)) 
D{p\\^)>D{r{p)\\r{u;)) 



(22) 
(23) 



in analogy with the monotonicity of the quantum relative 
entropy. 

Proof: For any 5 > choose 7 = D{p\\uj) + 5, then 
from Lemma |2] we have 

< Tr [{T{pn) > e"^T(c^„)}r(p„ - e"^c^„)] (24) 

< Tr[{p„ > e"^c^„}(p„ - e"Tc^„)] (25) 







(26) 



and hence D{T{p)\\T{uj)) < D{p\\uj) + S for all S > 
implying the inequality holds. 

Similarly, choose 7 = D,{T{p)\\T{uj)) — 6, then from 
Lemma |2] we have 

1 "^°° Tv[{T{p„) > e"^TK)}r(p„ - e"^c.„)] (27) 



<Tr[{p„> 



,"7, 



}iPn 



^n I \rn 



="7,, 



0] 



< 1 



(28) 
(29) 



and hence D{T{p)\\T{uj)) < Dip\\io) + S for all S > 0. ■ 
Corollary 1: The spectral divergence rates between two 
sequences of states are non-negative. 

Proof: Choose T to be the trace operation. Then for any 
7 < we have lim„^oo{l > e"'''}(l — e""*") = 1 and hence 
D{p\\u;) > D{P\\^) > 0. ■ 

Note that the spectral divergence rates between operators 
can be negative. An example of this that is introduced later 
is the conditional spectral entropy rates, which can be either 
positive or negative, and these are defined in terms of the 
divergence rates between the sequence of bipartite states and 
a sequence of operators derived from those states. 

IV. Spectral Information Rates 

Spectral information rates, the generalizations of entropy, 
conditional entropy and mutual information, may be defined 
in terms of the spectral divergence rates. In this section, 
the properties of the spectral information rates are examined 
and their relationship to the properties of the corresponding 
entropic quantities discussed. 

A. Spectral Entropy Rates 

Definition 2: The sup-spectral entropy rate is defined for a 
sequence of states p — {Pn}^=i of ^ quantum system X as 

Six) - ^D{P\\I) (30) 

where / — {I^}'^^^. The inf-spectral entropy rate S_{X), is 
defined as 

S{X) = -D{p\\I) (31) 



for a given sequence. 

The spectral entropy rates defined here are equivalent to the 
quantities obtained from the definitions in [4], which can be 
shown in a similar way to Propositions ^ and |2] 

Proposition 5: The spectral entropy rates are bounded 
above and below by 



0<SiX) <S{X)<logd 



(32) 



where the Hilbert space 7i„ of the system X is of dimension 

Proof: For any 7 > the spectral projection {p„ > 
gn7| = g as e"''' > 1 > A for A any eigenvalue of pn- Hence, 



D{P\\I) < D{p\\I) < 

and thus S{X) > S{X) > 0. 
To show S{X) < \ogd, we have 



0< D( 



-n log d 



I)^logd-S{X) 



(33) 



(34) 



and hence S{X) < S{X) < \ogd. ■ 

The next proposition states that any sequence of complete 
measurements on a system increases the spectral entropy rates. 
This property is the direct analogue of the i.i.d. case (in which 
the spectral entropy reduces to the von Neumann entropy). All 
complete measurements on a system are represented by unital 
CPTP maps on the system, assuming no conditioning on the 
result. 

Proposition 6: For any sequence of unital CPTP maps T 
and sequence of states p the inequalities 



^{TiX)) > ^(X) 
Sinx)) > S{X) 



(35) 
(36) 



both hold. 

Proof: From the definitions of the spectral entropy rates, 
and using Proposition 0] 

S{TiX)) =. -nnpW) = -D{T{p)\\T{I)) 

>-D{p\\I) = S{X) (37) 

where T{I) = I as Tn is unital for all n. The proof for the 

sup-spectral entropy rate is similar. ■ 

It may be noted that for bipartite sequences of pure states 

pAB ^ ||0Ai3|^^0Ai3|^|oo^^ fjjg reduced states p^ and p^ 

have identical spectra. Hence it is immediate that the spectral 
entropy rates for the reduced states are equal 



SiA) = S{B) 
S{A) = S{B) 

for sequences of bipartite pure states. 



(38) 
(39) 



B. Spectral Conditional Entropy Rates 

Definition 3: The spectral conditional entropy rates for se- 
quences of bipartite states are defined as 

^{A\B) = -Dip^^'Wl^ ® p^) (40) 

and 

SiA\B) = -:d(/^||/^ ® p^) (41) 
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respectively. 

Next, we give a relationship showing that the conditional 
spectral entropy rates are necessarily less than the correspond- 
ing spectral entropy rate of a source. 

Proposition 7: Conditioning reduces the spectral entropy 
rate, such that 



S{A\BC) < S{A\B) < S{A) 
S{A\BC) < S{A\B) < S{A) 



(42) 
(43) 



^ABC loo 

ln=l- 



for any tripartite sequence p^^'^ = {Pn 

Proof: The inequalities follow from Proposition 0] and 
the fact that the partial trace is a CPTP map. ■ 

The chain rules [7] in information theory relate the 
entropies, H{X) and H{XY), to the conditional entropy 
H{Y\X) and mutual information I[X : Y), e.g. H{XY) = 
H{X) + H(Y\X). Although the equalities given for the vari- 
ous chain rules do not hold in general, the spectral information 
rates are related by sets of inequalities. Examples are known, 
in each case, where the inequality is strict. 

Proposition 8: For sequences of bipartite states the condi- 
tional spectral entropy is related to the spectral entropies by 



S{A\B) > S{AB) - S{B) 



(44) 



giving a chain rule inequality. 

Proof: Defining the difference operators n„(a — /9) = 
p:^^ - e-"("-'3)/;^ (g) p^, and the projections P]_= {p^^ > 

g-n(a-/3)jA^^B|^ p^ ^ lA(^{pB > g-n/3| ^nd P2 = 1-^2, 

we have 

0<Tr[Fin„(a-/3)] 
= Tr[Pi(P2 + P2)n„(a - (i){P2 + P2)] 
= Tr[PiP2n„(a - I3)P2] + Tr[PiP2n„(a - /3)P2] 



+ Tr[PiP2p^^P2 + P2pi''P2Pi] 
+ Tr[{pf <e-"^K] 



(45) 



+ 2^Tr[{p^ < e-^^P}pB] ■ Tr[PiP2prP2] (46) 

The expression in ( 145 > is obtained by noting that as P2 and 
P2 both commute with I^(E)p^, the cross-terms in P2 and P2 
vanish. The final term in ( I46> is obtained as follows. Using 
the cyclicity of the trace, we can write 



Choosing a = S{AB) - (5 and /3 = 5(i?) + S for arbitrary 
S > implies that all the terms in inequality ( I46> vanish in 
the limit as ?i — > 00. Hence, we have 



SiA\B) > S{AB) - S{B) - 26 



(49) 



for all S>0. m 

Corollary 2: For sequences of bipartite states the condi- 
tional spectral entropy is related to the spectral entropies by 

'S{A\B) > max [S{AB) - 'S{B),S{AB) - S{B)] (50) 

giving further chain rule inequalities. 

Proof To obtain the first inequality in ( 15 Oi l, simply 
substitute a = 'S{A\B) + S{B) + 26 and /3 = 5(P) + 5 
for arbitrary 6 > into the proof of Proposition |8l 
For the second inequality in iSOl we bound the term 

Tr[PiP2pr^2] = Tr[PiP2(p;^^ - e^^/^f ® pf )P2] 



,-n7 7-/ 
-»7Tr[PiP2(/^«p^)P2] 



+ e-"^Tr[Pi(/;f®pf)PiP2] 

+ e-"^Tr[Pi(/;f ® Pn)PiP2] (51) 

using Lemma ^ where 7 = a — /3. The last two terms are 
obtained by noting that P2 commutes with I^(E) p^, and Pi + 
Pi = In^ ■ Substituting this relation into the final term of ( I46l l. 
and choosing (3 = S{AB)-S{A\B)-26 and a = S{AB)-6, 
for an arbitrary (5 > 0, we have Tr[Pin„(a — /3)] ^ 1 as 
n -> 00, and hence Tr[Pi(e""'>'/^ (g) p^)PiP2] ^ in this 
limit. Moreover, since Tr[Pin„(7)Pi] = 0, we have, 

|e-"^Tr[Pi(/;f ® pf)PiP2] I = |Tr[Pip;^^PiP2]| 

< 



Tr[P2PipPi]Tr[Pip^S] 
^ as n — > 00, (52) 

whenever 7 > 5^(^15), as Ti^Pip^^] -^ 0. Hence, the first 
and third terms of the sum in ( |46> vanish asymptotically, and 
therefore S{B) > S{AB) - 'S{A\B) - 26 for all 6 > 0. ■ 
Proposition 9: For bipartite states the conditional spectral 
entropy is related to the spectral entropies by 



S{A\B) < S{AB) - S{B) 



(53) 



giving a chain rule inequality. 

Proof: Defining the difference operators n„ (a + (3) 



TT[PiP2pf,''P2 + P2Pn''P2Pi]^Ti-[B^A + A^B] (47) p^^ - e-"("+«J^^, the projections Pi = {p^^ > 

"" '"^ ' ^ °^ - JA^ {pB > p-n/5} and P2 = 1 - P2, 



where A := \/p^ P2 and P := ^pJ^PsPi. Since the 
operator {A'^B + P^A) is self-adjoint, 

{Tt[B^ A + A^ B]f =4(ReTr[Atp])^ 
<4|Tr(Atp)P 
<4Tr[ylU] •Tr[P^P]. (48) 

where the last inequality is the Cauchy-Schwarz inequality for 
the Hilbert-Schmidt inner product. We then utilize the fact that 
Tr[AtA] = Tr[P2p:^^P2] = Tr[{p^ < e-"^}/?^] to obtain 
the resultant inequality. 



e -("+'5)/^^}, P2 
we have 

0<Tr[Pin„(a + /3)] 
= Tr[Pi(P2 + P2)n„(a + /3)(P2+P2)] 
= Tr[PiP2n„(a + /3)P2] + Tr[PiP2n„(c 

+ Tr[PiP2p;^^P2 + P2p;^^P2Pi] 
< Tr[{p^ > e-^}p^] 



P)P2 



'In^Pn)] 



2jTT[{pB > e--^0}pB] . Tt[PiP2P^^P2] (54) 
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proceeding analogously to the proof of Proposition |S] Choos- 
ing a = 'S{AB) - S{B) + 25 and /3 = S{B) - 5 for arbitrary 
(5 > implies the required inequality in the limit n ^ oo. ■ 
Corollary 3: For sequences of bipartite states the condi- 
tional spectral entropy is related to the spectral entropies by 

S{A\B) < min [S{AB) - S{B),S{AB) - 5(5)] (55) 

giving further chain rule inequalities. 

Proof: The first inequality is obtained by substituting 
a = S{A\B) - (5 and /3 = S{B) - 6 into the proof of 
Proposition |9l 

For the second inequality note that 

Tv[PiP2p;^^P2] 

= Tr[PiP2(pr - e-"("+« J„^ ^^^)P2] 

+ £-"("+« Tr [Pi P2(/;f «- In)P2] 

< Tr[{P2PiP2(pr - e-""/;f ® pf )] 



-"("+'') Tr[P2 Pi P2] 



< 



Tr[{pr > e-""4^ ® p^}{pi^ - e-""4^ ® pf )] 
■Tr[Pi(e-"("+'3)/;f^)]. 



(56) 



and 



Tr[P2pr]-Tr[{pf>e-"'^K] (57) 

Substituting ( I56> and ( I57> into the right hand side of (I54> and 
choosing (i = 'S{AB) - SiA\B) + 2(5 and a = 5;(A|P) - (5, 
for arbitrary (5 > 0, yields the desired inequality in the limit 
n ^ 00. This relies on the fact that for the given values of a 
and (i the term Tr[Pi(e-"("+'^)/,;f^)] vanishes in this Hmit. 

■ 

The chain rule inequalities may then be applied to derive 
many properties that are the generalizations of entropic in- 
equalities. 

Corollary 4: The conditional spectral entropy rates are 
bounded above and below by 

- logd < -'S{A) < S{A\B) < 5(A|P) < logd (58) 

for Hilbert spaces H^ of dimension d". 

Proof: For each state p^^ take a purification 
^ASc^^^ASCj^^ From the chain rule inequalities and Propo- 
sition |5] it then foUows that 

S{A\BC) < S{A\B) < S{A\B) < 5(yl) < logd . 

Using the chain rule inequality, then for states that are purifi- 
cations on ABC we have, 



-S{A) = S{ABC) - S{BC) < S{A\BC) 



(59) 



as S{ABC) = and S{BC) = S{A). ■ 

The strong-subadditivity relationships follow immediately 
from the chain rule inequalities and the monotonicity of the 
conditional spectral rates under partial traces. 

Proposition 10: The following strong-subadditivity rela- 
tionships 

S{ABC) + 5(P) < S{AB) + S{BC) (60) 

S{ABC) + S{B) < S{AB) + S{BC) (61) 



and 

S{ABC) + S{B) < S{AB) + S{BC) (62) 

S{ABC) + S{B) < S{AB) + 'S{BC) (63) 

hold for all sequences of tripartite states p^^'^ . 

Proof: These follow from Propositions |8] and |9j and their 

corollaries, and Proposition ■ 
Corollary 5: The subadditivity relationships 

S{AB) <S{A) +^{B) (64) 

S{AB) < min [S{A) + 'S{B),S{A) + S{B)] (65) 



{p;^^}- 1 take 



^ABC 



hold for any sequence of bipartite states. 

Proof: For any sequence p'^^ = 
a purification on a system C such that p 
||^ASc^^^yi_BC|^|cx^^^ and then utiHze strong-subadditivity 
and the equalities for bipartite pure states given in ( I38> and 
dH. ■ 

Corollary 6: The spectral entropy rates for any bipartite 
sequence of states obey the following inequalities, 



S{AB) > \S{A)-S{B)\ 

S{AB) > max \s{A) - 'S{B),S{B) - ^{A) 



(66) 
(67) 



which are the analogues of the Araki-Lieb inequality [8]. 
Proof: As for Corollary |5] ■ 

As the quantum information spectrum is a generalization of 
the classical case, the properties determined so far also hold for 
any finite alphabet classical source. A classical bipartite source 
is one where the reduced density matrices commute with the 
total state, that is [p-^^, /^®p^] = and [p^^, p^®/^] = 0, 
where [p, v] = pv — vp for operators p and v. For sequences 
of classical bipartite states a number of inequalities may be 
tightened. 

Proposition 11: The conditional spectral entropy rates are 
positive for classical states. 

Proof: As the states commute we may write them in a 
common eigenbasis, where 



„AB 



= ^Kj\ii){ii\AB 



(68) 



and without loss of generahty I^®p^ = J2ijk -^*;jNj)(*JUs- 
Therefore we have 

P{l) = {P^"" > e-""^!^ ® P''} (69) 







(71) 



if 7 = -5 < 0. This is due to the fact that Ay < e""* J2k ^kj, 

for all i, j. Hence we have S_[A\B) > 0. ■ 
Corollary 7: For bipartite sequences the following inequal- 
ities hold 

^{AB) > max ['S{A),S{B)] (72) 

S{AB) > max [S{A),S{B)] (73) 

for all finite-state classical sources. 
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C. Spectral Mutual Information Rates 

Definition 4: The sup-spectral mutual information rate is 
defined for a sequence of bipartite states p^^ 



as 



^B\ 



S{A:B) = D{p''''\\p''®p^) 



(74) 



Similarly, the inf-spectral mutual information rate is defined 
as 

„AB\\ / 



S_{A : B) ^ D{p' 



„B^ 



(75) 



for a given sequence. 

Proposition 12: For sequences of bipartite states: 

1) The spectral mutual information rates are always non- 
negative, 'S{A : B) > S{A : B)>0. 

2) The spectral mutual information rates decrease under 
CPTP mappings on one part of the system. 

3) The spectral mutual information rates are monotonic, 

S{A : B) < S(A : BC) 
'S{A : B) < S(A : BC) 

under reduction of the system size. 
Proof: These properties follow from the definitions and 
the properties of the spectral divergence rates. ■ 

Proposition 13: The following chain rule inequalities hold 



SiA 
S{A 
S{A 
SiA 



B) <'S{A) - S{A\B) (76) 

B) > max [SiA] - 'S{A\B),S{A) - S{A\B)] (77) 

B) > S{A) -S{A\B) (78) 

B) < min [S{A) ^ 'S{A\B),S{A) - S{A\B)] (79) 



for sequences of bipartite states. 

Proof: The proofs are similar to those given for previous 
chain rules. ■ 

V. Discussion 

The general relationships derived here apply to finite state 
quantum systems, of which finite alphabet classical states are 
a subset. Hence, all the properties derived apply in standard 
information theory with the assumption that the alphabet is 
finite. Several results contained in this paper are the finite 
state quantum generalizations of the properties described in 
Theorem 8 of [1], whilst others represent new inequalities 
in terms of the information spectrum in classical information 
theory. 
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